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INTRODUCTION 


This  paper  examines  a class  of  spectral  estimates  denoted  as  the  modified  maximum 
entropy  method  (MEM)  for  inputs  consisting  of  bandlimited  (finite  nonzero  bandwidth) 
signals  in  lowpass  additive  noise.  This  class  of  inputs  is  one  of  substantial  practical  applica- 
tion. For  instance,  a signal  considered  to  be  a Gaussian  process  of  some  bandwidth  may  be 
transmitted  through  a channel  exhibiting  the  “1/F”  type  frequency  absorption.  In  another 
example,  a pure  sinusoid  might  be  sent  through  a media  whose  time-varying  properties  serve 
to  modulate  the  sinusoid  and  broaden  its  frequency  characteristics. 

The  spectral  estimate  termed  in  this  paper  as  “modified”  MEM  differs  in  two  ways 
from  the  original  MEM  as  developed  by  Burg.  ^ First,  the  modified  MEM  incorporates  a 
variable  delay  A,  whereas  the  method  developed  by  Burg  is  for  unity  delay.  The  motivation 
for  removing  the  constraint  of  unity  delay  is  as  follows.  As  shown  by  Van  den  Bos,2  MEM 
spectral  analysis  is  equivalent  to  the  all-pole  linear  prediction  spectrum  for  unit  delay.  This 
MEM  spectrum  is  often  derived  using  the  coefficients  of  a linear  prediction  filter  which  are 
optimal  in  the  minimum  mean-square  error  (MMSE)  sense.  Often,  however,  there  arc 
situations  for  which  this  MMSE  filter  is  constructed  using  a delay  value  which  is  substantially 
greater  than  unity.  An  example  is  given  by  Alexander  and  Satorius^  whereby  the  bandlimit- 
ed signal  characteristics  of  a spectrum  are  separated  from  the  lowpass  noise  properties  on  the 
basis  of  an  MMSE  prediction  filter  with  variable  delay.  Since  the  MEM  spectral  estimate  is 
easily  derivable  from  the  filter  coefficients,  we  examine  the  properties  of  the  maximum 
entropy  spectrum  for  delays  other  than  A = 1 . Since  MEM  is  properly  defined  only  for 
unity  delay,  the  method  incorporating  a variable  delay  will  be  denoted  as  modified  MEM. 

A second  difference  between  MEM  and  modified  MEM  is  a power  scaling  term.  As 
developed  by  Burg,  MEM  contains  a numerator  scaling  factor  which  is  the  MMSE  power  due 
to  the  optimal  linear  prediction  filter.  The  inclusion  of  this  scaling  factor  causes  the  MEM 
to  be  a true  power  spectral  estimator  because  the  integration  of  the  MEM  spectrum  over  all 
frequencies  produces  the  true  input  process  power.  The  modified  MEM  spectrum  does  not 
contain  this  scaling  term  and,  as  pointed  out  by  Griffiths,^  is  not  a true  power  spectral 
estimate.  However,  it  is  shown  further  in  Reference  4 that  for  A = 1 the  modified  MEM 
spectrum  is  related  to  the  MEM  spectrum  through  a constant  scale  factor,  namely,  the 
MMSE  of  the  optimal  linear  prediction  filter  for  the  input  process.  Thus,  many  general 
properties  (such  as  spectral  shape,  peak  frequency  locations,  order  estimation,  etc. . . .)  of 
MEM  spectra  may  be  examined  equivalently  through  the  modified  MEM  for  unity  delay. 

The  work  presented  in  this  paper  is  concerned  with  two  areas:  an  examination  of 
the  mean  properties  for  the  unit  delay  modified  MEM  for  the  case  of  a bandlimited  signal 
in  a lowpass  noise  background  and  the  effects  of  variable  delay  length  upon  the  modified 
MEM  spectrum  for  this  input  process. 
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ANALYSIS 


LINEAR  PREDICTION  FILTER  IMPULSE  RESPONSE 

In  this  section  we  develop  the  structure  of  the  variable-delay  modified  MEM  spectrum 
through  analysis  of  the  associated  MMSE  filter  properties.  Thus,  we  develop  first  the  ex- 
pression for  the  linear  prediction  filter  impulse  response  and  then  illustrate  how  this  quantity 
determines  the  resultant  modified  MEM  spectrum. 

Consider  first  the  classical  Wiener  MMSE  prediction  problem:  given  a sequence  of 
data  values  extending  L-samples  into  the  past,  | x(k),  x(k  - 1 ), . . . , x(k  - L + 1 ) [ , we  wish 
to  form^the  best  estimate  (in  the  MMSE  sense)  of  the  sequence  value  A-samples  into  the 
future,  x(k  + A),  using  a linear  discrete  filter.  It  is  well-known  that  these  optimal  filter 
coefficients,  h(k),  may  be  obtained  by  solving  the  discrete  Wiener  matrix  equation 

Rh  = P^  ■ (1) 


In  Equation  1 , h is  the  weight  vector  containing  the  optimal  coefficients,  R is  the  L X L 
autocorrelation  matrix  of  the  input  process  and  is  the  L-length  vector  containing  the  auto- 
correlation elements  0xx^*^  8 = 0,1 , . . . , L - 1 . Equivalently,  Equation  1 may 

be  expanded  into  L simultaneous  equations  of  the  form 


L-1 

0xx(8  - k)  h(k)  = + ^)  , 8 = 0,  I,-.-,  L-1.  (2) 

k=0 


A method  for  analytically  solving  Equation  2 for  the  h(k)  used  in  several  recent 
works^>5>^  is  the  method  of  undetermined  coefficients.  Specifically,  this  method  was  used 
by  Alexander  and  Satorius^  in  their  solution  for  the  MMSE  filter  impulse  response  for  an 
input  consisting  of  a complex  bandlimited  signal  in  lowpass  noise.  The  solutions  obtained 
in  Reference  3 were  complex  weight  vectors,  corresponding  to  the  complex  input  signal. 
However,  Zeidler,  Satorius,  et  al,^  showed  that  for  widely  separated,  complex  exponential 
frequencies  the  weight  vector  solutions  for  real  sinusoids  could  be  obtained  by  a super- 
position of  the  composite  complex  exponential  weight  solutions.  A similar  assumption  is 
invoked  here ; that  for  complex  bandlimited  signals  widely  separated  we  can  obtain  weight 
solutions  for  real  bandlimited  signals  by  a similar  superposition.  Explicit  examination  of 
the  bandlimited  interference  mechanisms  will  be  done  in  a future  paper.  The  present  work 
is  limited  to  the  case  of  a single  bandlimited  complex  signal  in  lowpass  noise. 


The  autocorrelation  function  for  this  specific  input  is  given  by 

-eCc 


(/)xx(8) 


2 ~“N  I ® L 2 "“S' 
= Ov  e + Os  ^ 


Cl  jcj§8 


(3) 


where 


= noise  mean-square  power 

2 

Og  = bandlimited  signal  mean-square  power 
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“N’  “S  “ correlation  parameters  of  noise  and  signal,  respectively 

= radian  frequency  (relative  to  sampling  frequency)  of  complex 
bandlimited  signal. 

Using  the  inversion  integral,  the  spectrum  Sj^^(z)  corresponding  to  in  Equation  3 is 

given  by^ 

2ah  e~^^  sinh  avi  2oi  e~*^^  sinh  oc 

S (z)  ^ ^ ^ (4) 

This  form  of  the  input  power  spectrum  will  be  important  in  future  applications. 


Reference  3 has  derived  the  general  solution  for  the  MMSE  filter  coefficients  h^(k) 
for  an  input  process  given  by  the  autocorrelation  function  of  Equation  3.  The  A-notation 
in  h^(k)  signifies  the  A-dependance  of  the  impusle  response  through  BjfA)  and  CjCA) 
which  are  themselves  functions  of  A.  The  solution  for  h^(k)  is  given  by 

h^(k)  = B,(A)  zf  + B2(A)  z^  + CjfA)  6(k)  + C2(A)  6(k  - L + 1) 


k = 0,  1, . . . , L- 1 (5) 

where  | zj,  Z2}  = {e  are  the  zeroes  of  the  input  spectrum  and  | Bj,  B2,  Cj, 

C2  I are  given  as  the  solution  set  to  a 4 X 4 matrix  equation.  By  examining  the  asymptotic 
case  of  long  filter  length  L,  the  solution  given  by  Equation  5 simplifies  and  gives  a physical 
insight  into  the  resulting  filter  structure. 

For  long  filter  lengths,*  the  solution  for  the  weight  vector  reduces  to  : 

h^(k)  = B,(A)  e-f^^  e^®  **'  + CjIA)  5(k)  (6) 


where,  in  Equation  6, 


B,(A)  = 


C,(A)  = > 


J [|  . 1 -“S)]  [ ) 


(7a) 

(7b) 


Once  the  impulse  response  h^(k)  is  derived,  the  transfer  function  H^(z)  is  obtained  simply 
by  the  z-transform  operation: 


*Long  filter  length  signifies  L » 4/ft,  where  ft  is  given  by  the  location  of  the  input  spectral  zeros. 
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(8) 


L-1 

k=0 


Using  Equation  6 and  assuming  a very  long  filter  length,  H^(z)  becomes 
Bi(A) 


H^(z)  = 


l.,-^+j«lz-l 


+ Ci(A)  . 


(9) 


The  frequency  response  of  the  transfer  function  then  is  obtained  by  evaluating  H^(z)  around 
the  unit  circle  (making  the  substitution  z = e)^^).  The  frequency  response  is  thus  dependent 
upon  the  value  of  A chosen. 


MODIFIED  MEM  FOR  VARIABLE  DELAY 

Analogous  to  the  spectral  estimation  method  defined  in  Reference  4,  we  define  the 
variable-delay  modified  MEM  spectrum  as  Q^(z),  where 

Q^(z)  = l 1 -z-^H^(z)|"^  . (10) 

Similarly, 


QA(^)  = QA(z)|,^^jcu.  01) 

In  Equation  10,  H^(z)  is  given  as  in  Equation  8 and  z~^  signifies  a delay  operator  of  A 
samples  . For  the  case  of  a complex  bandlimited  signal  in  lowpass  noise,  h^(z)  is  given  by 
Equation  4,  H^(z)  from  Equation  8,  and  the  resulting  modified  Q^(z)  spectrum  computed 
from  Equation  10.  For  the  case  of  long  filter  length,  the  weight  vector  h^(z)  from 
Equation  6 is  used,  leading  to  H^(z)  given  by  Equation  9.  The  remainder  of  this  paper 
invokes  the  condition  of  long  filter  length  and  examines  analytically  and  graphically  the 
resulting  solutions  for  Q^(z). 
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ASYMPTOTIC  CASES 


LONG  FILTER  LENGTHS 

Makhoul^  shows  that  in  the  limit  as  L ^ the  MEM  spectrum  with  A = 1 will 
provide  an  unbiased  mean  estimate  of  the  true  power  spectrum  for  any  arbitrary  input. 

Thus,  utilizing  a delay  A = 1 and  L the  modified  MEM  reproduces  the  original  power 
spectrum  to  within  a scale  factor.  Figure  1 shows  an  input  spectrum  for  a band- 

limited  signal  in  lowpass  noise  where  the  given  parameters  refer  to  the  autocorrelation 
function  of  the  spectrum  as  given  in  Equation  3.  Figure  2 then  shows  the  resulting  modified 
MEM  spectrum  produced  by  three  values  of  delay.  In  Figure  2a,  for  A = 1 the  modified 
MEM  spectrum  is  a replication  to  within  a scale  factor  of  the  input  spectrum  For 

the  case  of  non-unity  delay  (as  shown  by  Figures  2a  and  2c)  a significant  spectral  distortion 
is  introduced  by  increasing  delay.  However,  the  spectral  peak  corresponding  to  the  center 
frequency  of  the  bandlimited  signal  is  retained  by  the  non-unity  delay  spectra.  The  spectral 
distortion  away  from  the  signal  center  frequency  produced  by  increased  delay  may  be 
qualitatively  explained  by  the  following  analysis.  Theoretically,  we  can  examine  the 
extrema  of  Q^(z)  by  solving  the  equation 

^Qa(z)  = 0 (12) 

for  the  locations  of  the  extrema.  With  Qa(2)  given  by  Equation  10,  this  leads  to  the 
condition 


A^(z)  ^ A^(z)  + A^(z)  1 A^(z)  = 0 (13) 


Figure  1.  Input  power  spectrum  for  bandlimited  complex  signal  in  lowpass  noise. 
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where,  in  Equation  13,  the  overbar  implies  complex  conjugation  and  A^(z)  is  given  by 

A^(z)=l-z-^H^(z)  . (14) 

In  general,  the  solution  to  Equation  13  is  a formidable  analytical  task  and  will  not  be  pursued 
further  at  this  time.  However,  some  general  properties  of  the  extrema  of  Q^(z)  may  be 
examined  by  considering  the  polynomial  A^(z)  in  Equation  14.  Since  it  is  known  that 
Qj(z)  reproduces  the  input  spectrum  within  a scale  factor,  the  polynomial  Aj(z)  must  be  of 
the  proper  order  to  estimate  correctly  the  input  spectrum.  Thus  any  increase  of  delay  past 
* A = 1 will  serve  only  to  introduce  additional  z-domain  roots  into  Equation  14.  These  newly 

introduced  roots  thus  appear  in  Q^(z)  as  additional  poles  in  the  z-plane,  which  serve  to 
distort  the  spectrum  away  from  the  signal  center  frequency.  As  A is  increased  by  one,  the 
t order  of  Q^(z)  is  thus  increased  by  one,  producing  an  extra  pole  at  some  location  Zp  = 

e^+jb  Q^(z)  is  evaluated  around  the  unit-circle  (z  = to  form  Q^(tu),  two 

additional  extrema  (one  maxima  and  one  minima)  appear  in  the  range  -tt  < co  < tt.  From 
this  development  for  an  arbitrary  delay  A = D,  a total  of  2(D  - 1 ) additional  extrema  appears 
in  Q^(co)  and  considerable  distortion  of  the  signal  input  may  result. 

Although  the  spectral  distortion  as  shown  in  Figure  2 is,  in  general,  undesirable,  there 
are  some  situations  in  which  these  can  be  beneficial  results  by  increasing  delay  beyond  A = 1 . 
An  example  is  shown  beginning  with  Figure  3,  which  is  considerably  lower  power  bandlimit- 
ed  signal  than  that  of  Figure  1 . In  and  in  Qifcu)  shown  in  Figure  4a  the  lowpass 

noise  dominates  the  spectrum.  However,  by  increasing  A past  unity  (Figures  4b  and  4c)  the 
effect  of  the  lowpass  noise  on  the  resulting  Q^(co)  estimate  may  be  made  smaller  and 
smaller.  The  power  in  the  bandlimited  signal  is  not  attenuated  greatly  for  increasing  delay 
and  the  signal  center  frequency  is  estimated  correctly  by  Q^(co)  for  increasing  delay.  The 


Figure  3.  Input  spectrum  for  bandlimited  complex  signal  in  lowpass  noise. 
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(CJ)  POWER.  dB  Qj-lw)  POWER.  dB  Q,  (w)  POWER.  dB 


decorrelation  of  the  lowpass  noise  is  due  to  the  properties  of  the  linear  prediction  MMSE 
filter  H^(cj),  as  developed  in  Reference  2.  The  bandlimited  signal  has  a longer  correlation 
distance  than  the  lowpass  noise  and  thus  is  not  decorrelated  so  severely.  An  asymptotic 
property  of  Q^fco)  for  large  delay  lengths  may  also  be  inferred  from  the  plots  in  Figures  2 
and  4.  As  A is  made  significantly  larger  than  the  correlation  distance  of  the  bandlimited 
signal,  the  linear  prediction  filter  H^(w)  is  no  longer  able  to  extract  the  bandlimited  signal 
properties  from  the  input  series,  and,  in  the  limit  for  large  delay  H^(aj),  approaches  zero 
for  all  CO.  This  latter  property  may  be  seen  in  the  limits  of  B j(A)  and  C j (A)  for  A -►  <». 
From  Equations  7a  and  7b, 


limBi(A)  = 0 

A oo 

(15a) 

lim  Ci(A)  = 0 

A oo 

(15b) 

which  gives  from  Equation  9, 

lim  H^(co)  = 0 

A oo 

(16a) 

and  thus  from  Equation  10, 

lim  Qa(w)  1 

(16b) 

A oo 

Thus  the  result  of  using  a very  long  delay  value  is  to  whiten  perfectly  the  Qa(co)  spectrum, 
which  is  illustrated  in  Figures  2 and  4.  For  increasing  A-values,  the  spectral  ripples  grow 
lower  in  amplitude  and  closer  in  frequency  until,  for  very  long  delay  values,  the  resulting 
spectrum  is  effectively  white.  The  delay  necessary  to  whiten  the  input  spectrum  must  be 
chosen  to  be  much  greater  than  the  longest  correlation  distance  of  any  bandlimited  signal 
present.  For  a bandlimited  signal  with  bandwidth  parameter  ccg,  as  given  by  Equation  3, 
the  delay  must  be  given  by  A » l/a§  to  achieve  this  whitening. 


BANDLIMITED  SIGNAL  IN  WHITE  NOISE 


The  analytical  results  for  a bandlimited  complex  signal  in  white  noise  are  easily 
obtained  from  the  previous  derivations  through  a simple  limiting  operation.  From  Equation  3 
we  see  that  the  autocorrelation  function  for  a complex  bandlimited  signal  in  white  noise  is 
obtained  if  one  allows  to  approach  infinity.  The  effect  on  the  weight  vector  solution  is 
such  that  for  long  filter  lengths,  Cj(A)  from  Equation  7 vanishes  and  h^(k)  is  given  by 


where 

B',(A) 


llm  B,(i)  = . .“S-"  W|-"s)]  . 


(17) 

(18) 
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But  as  shown  in  Reference  3 for  white  noise,  the  exponential  frequency  0 j is  exactly  equal 
to  the  bandiimited  signal  center  frequency  cj§.  This  gives  for  h^(k)  the  expression 

The  transfer  function  H^(z)  for  long  filter  length  is  then  given  by  Equation  9 as 


H^fz) 


(20) 


The  modified  MEM  spectrum  Q^(z)  is  then  given  by  (using  Equations  10,  14  and  20); 


(21) 


where 


A^(z)  = 


_ , - - (1  - e“S-^  ,-l 


-p+juig  _1 
1 - e z * 


(22) 


A simple  closed  form  expression  for  Q^(z)  may  be  obtained  for  the  special  case 
A = 1.  Thus  setting  A = 1 in  Equation  22  and  substituting  in  Equation  21,  we  can  calculate 
Qj(z),  which,  after  simplification,  becomes 


ttc-U 

Q,(z)  = e ^ 


-)  jwc  j2cjc 

z'“  - 2ze  cosh  /i  + e 

">  _ jfk’S  , j2o)o 

I z"  - 2ze  cosh  «§  + e 


(23) 


Using  the  relationships  developed  thus  far,  we  may  now  verify  analytically  the 
equivalence  (within  a scale  factor)  of  Qj(z)  and  S^j^(z)  for  the  case  of  a complex  bandiimit- 
ed signal  in  white  noise.  The  spectrum  S^j^fz)  for  this  input  may  be  obtained  from  Equa- 
tion 4 by  allowing  -*■  This  gives 


Sxx(^>  = 4 + 


-a 

e 


S 


sinh 


(24) 


Combining  terms  in  Equation  23, 

2 { z“  - 2ze^^^  [cosh  a§  + (a§/o^)  sinh  ag]  + | 

^xx^^^  ^ j2cjc 

z^  - 2z  cosh  o§  e ^ + e ^ 

The  spectral  zeros  of  Sxx(z)  thus  are  given  by  solving  for  the  roots  of 


(25) 


I 


I 


t 
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where,  in  Equation  25, 


a = cosh  CKg 


sinh  . 


Solving  Equation  25  via  the  complex  quadratic  formula  gives 


(26) 


z,  =e^“S  = 

(27a) 

(27b) 

These  equations  give  the  relations 

^1  = cos 

(28a) 

e"^  = a-v/a^-  1 

(28b) 

e^  = a - 1 . 

(28c) 

The  first  relation  states  that  the  complex  exponential  component  of  the  weight 
vector  solution  for  white  noise  is  at  exactly  the  bandlimited  center  frequency,  regardless  of 
signal  bandwidth.  The  last  two  relations  may  be  used  to  derive  the  following: 


cosh  n = 


2 


= a 


(29) 


Substituting  this  relation  into  Equation  24  for  we  get 


Sxx(z)  - 


7?’  - 2ze^‘*^^  cosh  n + 

■ - 2ze'*^^  cosh  ■ 


(30) 


Comparing  this  result  with  the  expression  forQj(z)  as  given  by  Equation  23,  Qj(z)  and 
Sjjjj(z)  are  indeed  equivalent  to  within  a scale  factor: 


a^-H 

Ql(z)=  r—  ISxx(z)]  . (31) 

‘'N 

f Figure  5 shows  the  power  spectrum  of  a moderately  bandlimited  signal  in  white 

noise.  Figure  6a  then  gives  the  modified  MEM  spectrum  for  A = 1 and  the  reproduction  of 
Sxx(w)  may  be  seen  clearly.  The  parameter  for  this  case  equals  0.783  and  thus  the 
« scaling  factor  becomes 

as-/i 

- = 4.33  = 6.4  dB 
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Figure  6.  Modifled  MEM  spectra  for  input  spectrum  of  Figure  5. 
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Thus  the  modiried  MEM  spectrum  has  the  exact  spectral  shape  as  but  is  6.4  dB 

higher  in  power,  as  shown  by  comparing  Figures  5 and  6a.  Figures  6b  and  6c  are  the  modi- 
fied MEM  spectrum  for  A = 9 and  A = 1 7,  respectively,  and  the  spectral  flattening  due  to 
longer  delay  is  clearly  evident.  The  height  of  the  spectral  peak  at  cug  decreases  rapidly  with 
delay  due  to  the  bandwidth  of  the  signal. 

In  contrast  to  this,  consider  the  narrower  bandwidth  peak  shown  in  Figure  7,  the 
modified  MEM  estimates  of  which  are  shown  in  Figure  8.  For  A = 1 , Q | (cj)  is  again  seen  to 
give  an  excellent  reproduction  of  Sj(x(w)  with  the  associated  scale  factor.  The  effects  of 
increased  delay  in  Figures  8b  and  8c  are  shown  to  be  less  drastic  upon  the  signal  peak  than  i 

in  the  preceding  example.  This  is  due  to  the  longer  correlation  distance  of  the  narrower 
bandwidth  signal  of  Figure  7.  However  the  spectral  rippling  due  to  the  inclusion  of  addi- 
tional poles  in  Q^(co)  is  still  evident.  • 
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Figure  7.  Spectrum  uf  bandlimited  complex  signal  in  white  noise. 
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